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Abstract. Construction of a scale space with a convolution filter has 
been studied extensively in the past. It has been proven that the only 
convolution kernel that satisfies the scale space requirements is a Gaus- 
sian type. In this paper, we consider a matrix of convolution filters in- 
troduced in [1] as a building kernel for a scale space, and shows that we 
can construct a non-Gaussian scale space with a 2 x 2 matrix of filters. 
The paper derives sufficient conditions for the matrix of filters for being 
a scale space kernel, and present some numerical demonstrations. 

1 Introduction 

Linear scale-space representations have been applied to many signal and image 
processing problems [5] [3J, in which an optimum amount of smoothing cannot be 
determined in advance. The linear scale space smoothing iteratively applies a 
linear diffusion operator to the signal until an appropriate amount of smoothing 
is introduced. 

Recently, we proposed a new approach to signal smoothing Q] , which is lin- 
ear, diffusion-like, but possesses different frequency characteristics from the lin- 
ear diffusion operator; as the number of iteration increases, our filter develops 
a sharper cut-off but retains the bandwidth much longer than the linear diffu- 
sion. The filter was designed from a geometrical perspective and called Elastic 
Quadratic Wire (EQW). We can consider EQW smoothing as applications of 
linear filters (in particular circular convolution filters) to the signal and its aux- 
iliary extensions in a computational structure similar to a linear transformation 
by a 3 x 3 matrix where each component is one of the convolution filters. 

Our goal is to understand the frequency characteristics of EQW and derive 
general requirements on the filter coefficients to meet the scale space criteria [4] [3] . 
It has been shown that the only convolution kernel that satisfies the scale space 
requirements is a Gaussian type for the continuous time space [5][I][B] an d the 
modified Bcsscl functions of integer order for the discrete time space. The latter 
approaches the Gaussian kernel as the length of the filter increases. In this paper, 
instead of considering a convolution filter, we consider a matrix of convolution 
filters employed for the EQW smoothing. In particular, instead of 3 x 3 matrix 
of filters as in the original EQW, we study a 2 x 2 form. Although smaller in 
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size, the configuration retains some of intrinsic characteristics of the original 
EQW and allows us to characterize the frequency response algebraically. We 
will extend the results in the future for larger and more general configurations. 

2 Background 

We consider the following linear system. 
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where P is the order of the system, Xg (1 < s < P) are discrete signals of 
length TV in which the number inside [ ] indicates the iteration number, t > 
is a scale parameter, f rs (1 < r, s < P) are linear filters, and * is a circular 
convolution operator. The operator is applied iteratively, and ([1]) implies that 
the outputs of Ith iteration becomes the inputs to the I + 1st iteration. We call 
this computational structure a matrix of filters, as the filters can be arranged 
in a P x P matrix form and the operation can be conveniently viewed as a 
multiplication (defined as in |Tj)) of the matrix with the input signals. Figure [T] 
shows two stages of a P x P matrix of filters. Note that the computation at each 
stage is identical. 



2.1 Equivalent filter 

Let M rs be a N by TV circulant matrix that implements the linear filter of f rs . 
Let 
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Write the Ith power of M as 
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Then, the signal at Zth iteration can be expressed in terms of the initial signals 

(4) 
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Fig. 1. A schematic of a P x P matrix of linear filters. A rectangle with *f rs is 
a linear filter whose impulse response is f rs - A circle with + receives P inputs 
and adds them at every cycle. 
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Now we designate xi as the primary signal and x s (s > 1) as auxiliary ones. 
Initially, all auxiliary signals are set to zero. Then, xj and M^j determine xf , 
the primary signal at the Zth iteration. is also circulant as circulant matrices 
are closed under addition and multiplication. Therefore, it implements circular 
convolution of a filter denoted as ffl , which we call an equivalent filter at Zth 
iteration. The equivalent filter transforms xf to x^ . 



2.2 Eigen-decomposition 

Define 



fn(i) . . . fip(i) 
B t =| : •, : (5) 



fpi(i) . . . fpp{i), 
where f r ,(i) denotes the ith coefficient of f rs and 
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U(p k ) = J2 V*P lk (6) 

where p — e j2 ' 7r / jv . Then, the eigenvalues of H (0 < k < N — 1) are eigenval- 
ues of M. For each k, there are P eigenvalues. Thus, there are total of PN eigen- 
values for M with possible repetition. Let A* (i G {1, . . . P}) be an eigenvalue of 

H(p k ) and v k be the corresponding eigenvector. Let r k = [p° p k ■ ■ ■ p*^ -1 )] 
(with the superscript T denotes transposition). Then 0r(p fc ) where ® de- 
notes the Kronecker product is an eigenvector of M. 

Let V fe = [v^ . . . vp] , g k be the first row of V fc , and g fc be the first column 

of (V fe )~\ Thus, 

g fe ■ g fc = 1. (7) 

Let Dj (i € {1 . . .P}) be an N by N diagonal matrix where fcth diagonal 
component is A^ and Gi be another N by N diagonal matrix where fcth diagonal 
component is p k = g k (i)g k (i). Note that g fc (i) denotes the ith component of g fe . 
We call p k mixing coefficients, and 



£m? = 1, ( 8 ) 



for all < k < N - 1 due to Q. 

Then, can be decomposed by 

p 

M^|=W^D^GiW T (9) 

i—l 

where W is the N by N discrete Fourier transformation matrix and W rs = p rs = 
e j2nrs/N _ jj cncej ^\=i D'Gj gives the frequency response of the equivalent filter 
at Zth iteration. 
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2.3 Scale-Space Filters 

We are interested in incremental smoothing of signals with small size filters. In 
literature, the approach is often referred to as scale space filtering and plays an 
important role in many signal and image processing applications. To maximize 
the control of the smoothing, we limit the number of non-zero filter coefficients 
in f rs to three, the smallest symmetric filter size that allows construction of scale 
space. Thus, we assume B; = for i </ { — 1,0,1}. In this paper, we consider 
requirements on f rs for a 2 x 2 matrix of filters so that its equivalent filter satisfies 
conditions for a scale space filter. 

We impose the following conditions on equivalent filters. 

1. Real frequency response: f|j is symmetric. In other words, the Fourier trans- 
form of the equivalent filter is real. 

2. Positive response: Its frequency response is non-negative at every frequency 
component. 

3. Unimodal response: Its frequency response is unimodal with the peak at the 
frequency 0. 

4. Consistent reduction response: Each frequency component is non-increasing 
with respect to the iteration number. 

5. Normalized response: The DC component of the Fourier transform is 1. 

6. Equivalence to linear diffusion: It can be reduced to a common linear diffu- 
sion operator when the auxiliary signals are fixed at zero. 

The first requirement prevents any phase distortion after the smoothing. The 
second through fourth requirements prevent any new local minimum or local 
maximum from forming as the result of smoothing, and are considered essential 
for scale space representations. Note that the fourth requirement is trivially 
satisfied for a conventional scale space filtering when the second requirement 
is satisfied. That is not the case for the matrix of filter based construction. 
The fifth requirement preserves the mean value of the signal. The equivalent to 
linear diffusion requirement states that the system without contributions from 
the auxiliary signal will result in linear diffusion. An iteration formula for the 
linear diffusion is [3] 

x^' +1 = (1 - 2t) xj + t (zx\ + z' 1 ^) • (10) 

where z and shift signals by one to the left and right, respectively, and 
t G [0, 1/4]. 

3 Formulation 

We introduce notations specific to the case of 2 x 2 matrix of filters. To reduce 
the amount of arabic subscripts, we use x instead of xi as the primary signal 
and a for the sole auxiliary signal, and write the processing of the 2x2 matrix 
of filters as 

f x V+n\ _ f x V]\ /f ra * x W+f xa * a [ i ]\ 

^ a [i+i] ) - \ a [«] ) +t \f xa * xM + f OQ * aW )' (U) 
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Each convolution filters have at most three non-zero coefficients. Thus, we write 
them f„» = [a** 7**] with one tap delay so that is the center of the filter. 
(Replace ** with xx, xa, ax, or aa.) 

Note that fee [0, iV — 1] where TV is the length of the input signal. Thus, as 
N — > 00, p k covers all roots of unity. Since we want to derive design requirements 
for any signal length, we treat all quantities as functions of/3 = {zeC||2;| = l} 
or equivalently 9 = Zp e [— 7r, it}. This allows us to generalize our discussion and 
eliminate the superscript k from expressions. 

With these notations, eigenvalues of B are 



Xl ( P ) = ^M+^vg(g ( i 2) 



, , , cr xx (p) + cr aa (p) + ^/ A{p) 

MPJ = ^ ' ( 16 > 

(14) 



and mixing coefficients are 



Mp) = _ ^(p)-^ (p) + l (15) 



2yz^y 2 

;(P) ~ g QQ (p) 1 

2^A{p) 2 



M2(p) = ^_o^) + l (16) 



where 

er**(p) = <y**(p) + £ (a**/}" 1 + /3** + 7**/o) (17) 
A{p) = {a xx (p) - <J aa (p)) 2 + 4:<Jax(p)<Jxa(p)- (18) 

with 5 rs being the Kronecker's delta function (1 when r = s and otherwise). 
Note that in (fl~5j) and (fl"6|). we are assuming that the eigenvalues are distinct 
(or A 7^ 0). When Ai = A2, the mixing coefficients are arbitrary, and we set 
Ml = /-*2 = 1/2. 

Note that the above expressions are all functions of p (or equivalently 9). 
However, for brevity, we omit the variable in their expressions unless we are 
evaluating them at a particular p. 

The frequency response of the equivalent filter at Ith iteration is 



F l = D[G! + D\G 
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( @xx ~t~ O aa v A \ 
Ml o +^2 ^ ■ (19) 



4 Filter Requirements 

In this section, we derive a sufficient condition for a 2 x 2 matrix of filters to satisfy 
the scale space requirements. We first use necessary conditions to simplify the 
formulae of the individual filters. We then use the simplified formulae to derive 
sufficient conditions on the design parameters. 
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Theorem 1. Necessary conditions for a 2 x 2 matrix of filters being a scale 
space filter are 

a xx = (l-2t)+2tcos6 (20) 
a aa = (1 - 2bt) + 2tccos8 (21) 
o-xaO-ax = -4t 2 dsin 2 6» (22) 

where b,c,d€ R. 

Proof. F l at the first three iterations (/ = 1, 2, 3) are 

F 1 = <r xx , (23) 

F 2 = {cr xx ) 2 + cr xa a ax , (24) 
F = {a xx f + 

2 , &xx&xa@ax ~t~ &aa&xa&ax ■ 

(25) 

Since they have to be real according to the real frequency response requirement, 
ffxx, o~axO~xa and o~aa have to be real. o~ xx is real for any k if and only if a xx = i xx 
or f xx is symmetric. a aa is real for any k if and only if a aa = i aa or f aa is 
symmetric. o~ ax a xa is real for any k if and only if either both o~ ax and o~ xa are 
real or both are imaginary. Thus, f ax and f xa are either both symmetric or anti- 
symmetric. Below, we show that either way, we will get the same condition for 
o~axO~xa- Now, let's introduce constraints derived from other requirements. 

Due to the equivalence to linear diffusion requirement, we set a xx = Ixx = 1 
and ti xx = — 2, which gives 

a xx = (1 - 2t) + 2t cos 9. (26) 

For the normalized response requirement, the frequency response at = 
has to be 1 for all I. Thus, F 1 (9 = 0) = F 2 (0 = 0) = 1 has to be true. This gives 
o~ xx {Q = 0) = 1 and a xa (6 = 0)o- ax (9 = 0) = 0. The former is satisfied with (l26l) . 
The latter gives 

{ctax + Pax + lax) = 0. (27) 

Due to the constant reduction and the positivity requirements, < F 2 (9) < 
F 1 (6) or < al x + a xa a ax < a xx for any t g [0, 1/4]. Consider t = 1/4. Then, 
o~xx{9 = tt) = 0. Hence, we have 

0- X a{^)o- a x{^) = (Am - OL xa - -f xa ) ((3 ax - a ax - lax) = 0. (28) 

Now, we investigate if f xa and f ax should be both symmetric or anti-symmetric. 
First, Assume both are symmetric. Thus, j xa = a xa and i ax — a ax . Because 
of the symmetry of ([2"T]) and P5|) . we consider {a ax + Pax + lax) = and 
{Pxa — ctxa — Ixa) = 0, and the derivation for the other case will be the same. 
We have a ax = lax = —/3 ax /2 and a xa = i xa = f3 xa /2, and obtain 

o-xa<Jax = t 2 /3 xa f3 ax (l - cos 2 0) = t 2 /3 xa [3 ax sin 2 9. (29) 
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Next, assume that both i xa and i ax are anti-symmetric. Thus, j xa — —a xa , 
lax = — a-axi and f3 xa = /3 ax = 0. In this case, both (|27| and (|28j) are satisfied. 
Furthermore, 

OxaOax = -^ttxaCtax SHI 2 (30) 

Therefore, given symmetric version of f xa and i ax , we can always find anti- 
symmetric counterpart that provides the same expression for a xa a axi and vice 
verse. 

Let fiaa = b and a aa = j aa = c. Then, we have a aa = (1 — 2bt) + 2ctcos6. 
Let both f xa and f ax are anti-symmetric, and a ax a xa = d. Then, we obtain the 
necessary condition. □ 



We have found that all scale space filters can be expressed by ([20]) , ([21]) , and 
|). There are three design parameters: b, c, and d. The next theorem provides 
requirements on these parameters. 

Theorem 2. Sufficient conditions for a 2x2 matrix of filters being a scale space 
filter are that they are in the forms of \2Cfy - h22\) and 

0<6 + c<2, (31) 

-2d<b-c>-2d, (32) 

c(b-c)>2d, (33) 

c 2 - (2 - b)c + 2d<0 (34) 

Proof. We first derive constraints on the three parameters for each scale space 
requirement. 

Real frequency response requirement: 

Since o- xx , a aa and a xa a ax are all real and consequently Z\, /zi, fJ-2, Ai, and 
A2 are all real, the real frequency response is satisfied. 

Equivalence to linear diffusion requirement: The equivalence to linear 
diffusion requirement is satisfied with (|20j) . 

Normalized response requirement: At 6 = 0, <J xa a ax = and A = 

(oL-oL) 3 - If °lx > Ai = 0, A 2 = 1, fa = 0, and /i 2 - 1. Thus, 

F l (6 = 0) = 1 for all I > 1. If cr° T < cr^, A x = 1, A 2 = 0, /ii = 1, and 
ii2 = 0. Again, F' (6 = 0) = 1 for alH > 1. Therefore, the normalized response 
requirement is satisfied. 

Positive response and consistent reduction requirements: For conve- 
nience, we treat the two requirements together. Let 

4> = °~xx + Paa, (35) 

^ = o-xx - o- aa . (36) 

Then, 



2V^ I 2 J + 2 \/Z I 2 j 



(37) 
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The positive response requirement is satisfied if 

V> < Va 
4>>Va, 

and the consistent reduction requirement is satisfied if 



ip < VA 
+ < 2. 

Thus, both conditions are satisfied if 

ip < y/A (38) 

VA < 4> < 2 - VA. (39) 
Since A = {ipf - dsin 2 6, ® is satisfied for all 9 if 

d < 0. (40) 

With c/><2 - s/A, we have 

A< (2 - 0) 2 , </> < 2. (41) 

Now, 

(2 - <f>) 2 - A = 16t 2 ((c -d)w-(b+ d)) (w - 1) > (42) 
where w — cos9. Since — 1 < w < 1, w — 1 < 0. Thus, (|42|) is satisfied if 

(c - d) w - (b + d) < 0. (43) 

The above inequality holds if and only if it holds at it) = 1 and w = — 1. Hence, 

b - c > ~2d (44) 

b + c > 0. (45) 
With \f~A < 4>, we have a xx a aa > o xa o ax or 

(1 - 2t + 2tw)(l - 2tb + 2tcw) > -4dt 2 (l - w 2 ). (46) 

Define 

r](t, w) = (1 - 2t + 2tw){\ - 2tb + 2tcw) + 4dt 2 (l - w 2 ) 
= 4(l-w)(b + d-(c- d)w) t 2 - 2 (1 + b - (1 + c)w) t + 1. 

To show (|4"B|) . we need to show ij(t, w) > 0. 

Before deriving sufficient conditions for ri(t,w) > 0, we find two necessary 
conditions for (|46|) . We then show that the two conditions together with BO)) , 
(|44|) . and (|45]l form sufficient conditions for rj(t 7 w) > 0. 



10 



The right hand side of (|46|) is non-negative with(37) and 1 — It + 2tw > for 
< t < 1/4 and -1 < w < 1. Thus, it is necessary that 1 - 2tb + 2tcw > 0. By 
setting t = 1/4 and w = 1, we have 

b-c<2. (47) 

By setting t = 1/4 and w = — 1 , we have 

6 + c<2. (48) 

When (1 — w) (b + d — (c — d)io) = 0, iy) > because 

Tj(t, 1) = 1 - 2(6 - c)f > 1 - (b - c)/2 > 

(using i < 1/4 and b — c < 2) and 

r/(t, -1) = 1 - 2 (2 + (6 + c)) t = 1 - it > 

(using 6 + c = derived from 6 + — (c — 1) = and t < 1/4), and rj(t,w) 
in this case is a linear function of w. 

With (1 - w) {b + d - (c - d)w) ^ 0, we have 

(i + b-(i + cH 2 

4(1 - tu) (6 + d - (c - d)w) ' 

This is convex (4(1 — w) (b + d — (c — d)w) > 0) parabola of t with its center 
located at the positive side (1 + b — (1 + c)w > 0). A necessary and sufficient 
condition for the above inequality is 

77(0,10) >0, (49) 

r7(l/4,io) > 0, (50) 



and 



provided that 



or 



(i + *-(i + cH 2 ^ (5l) 



4(1 -to) (b + d-(c-d)w) 
1 + b - (1 + c)w 



4(1 -w) (b + d-{c-d)w) 



< 1/4 (52) 



< 1 + b - (1 + c)w < (1 - w) (b + d - (c - d)w) . (53) 
The first condition is trivially satisfied. The second condition is satisfied since 

7/(1/4, w) = -(1 - 10) (2 - (b + d) + (c + d)w) (54) 
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and 1 — w > and 2 — (b + d) + (c + d)w > 0. (Note that at w = 1, we have 
2 — (6 — c) > because & — c < 2, and at w = — 1, we have 2 — 2c? — (b + c) > 
because &+c<2<2- 2d) 

For the third condition, (jSTj) with ([55)1 gives 

1- (1+ wr (1 , + ^ W) ^ x > 1~t(1- w)(b + d-(c-d)w) (55) 
4(1 - w) (b + d - (c - d)w) 4 V /v v ; ; v ' 

Thus, the third condition is satisfied if the right hand side of the above is non- 
negative. In other words, we need to show 

C(w) = 4 - (1 - to) (b + d - (c - d)w) = (c - d)w 2 + {b- l)w + (1 - d) (56) 

is non-negative. Indeed, C(-l) = 2 - 2d - (b - c) > and £(1) = b + c - 2d > 0. 
Therefore, if c - d < 0, then ((w) > in -1 < w < 1. If c - d > 0, then 

«-> = <<= - d) (- + s^y) 2 - + 4 - " + "» (57) 



and we need to show that 

(6 + c) 2 



+ A-(b + d)>0 (58) 



4(c-d) 

provided (6 + c)/(c — 0!) < 2. This is indeed the case, since 

" ?, + + 4 - (& + <2) > 4 - (c - d) - (& + d) = 4 - (& + c) > 2. (59) 
4(c — a) 

Unimodality Requirement: Note that 
dF\0) 



89 



^ (cos 9, t) sin 6, (60) 



where 



Z\\ , (4>->/A\ \ (2AU-^ A 



2 / \ 2 M\ 4/A^ 



2sfA 2) \ 2 ) \ Ay/A 



1-1 



with 



2^/A 2 j y 2 ) y A^A J ' 

&(t)=2i(l + c), (61) 
&(t) = 2t(l-c), (62) 
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U(w,t) = 8t 2 ({l~c)(-{l-b) + {l-c)w)+4dw). (63) 

Note that d(j)(0)/6 = -^(i)sin(0), dip{8)/6 = sin(0), and dA{6)/0 = 

U(t) sin(^). 

The unimodality requirement is satisfied if t;(w,t) > in —1 < w < 1 and 
< t < 1/4. Observe that £(w,t) > if 

2Z\^ - ^£4 > (64) 
2VA^ -U>0 (65) 
+ > 0, (66) 

provided that the positivity requirement is satisfied. 
Now, 

2A^ - ^ = -64dt 3 ((1 - c) + (1 - &H (67) 
is a linear function of w. At w = 1, 

2Z\^ - VCzi = — 64dt 3 (2 - (6 + c)) > (68) 

by go]) and (08]). At w = -1, 

2z% - ip£ A = -64dt 3 (b - c) > (69) 

by (00]) and gll). Hence 2-4^ - > 0. 
(1651 and (|66|) can be combined into 

e > o (70) 

ml - & > 0. (71) 

(|70)) is satisfied if and only if 

c>-l. (72) 

Let 

0M=44$-&. (73) 

We first evaluate necessary conditions $(1) > and $(—1) > 0, then show that 
the necessary conditions are also sufficient for (fTTj) ■ 

= 4{b-c + 2d) (&c-2d-c 2 ) > 0. (74) 
Since b — c + 2d > according to (|4"4"]) . 6c — 2<i — c 2 > 0. Hence, we have 

fee - 2d - c 2 > 0. (75) 

$(-1) =A{b + c-2d-2) (be + 2d + c 2 - 2c) > (76) 

Thus, either b + c - 2d - 2 > and be + 2d + c 2 - 2c > or b + c - 2d - 2 < 
and be + 2d + c 2 — 2c < 0. However, 

(6 + c - 2d - 2) + (be + 2d + c 2 - 2d) = {b + c - 2) (c + 1) < (77) 



13 



according to (|48[l and (|72|) . Therefore, we have 

b + c- 2d -2<0 (78) 

6c + 2d + c 2 - 2c < 0. (79) 

Now, we show that these conditions are sufficient for -d(w) > in — 1 < iu < 1. 
When (f — c) 2 + Ad = 0, d(w) reduces to a linear expression of w, and i?(l) > 
and tf(-l) > are sufficient for > 0. When (f - c) 2 + 4d ^ 0, 

tf(w) = a (to - w c ) 2 + /3 (80) 

where 

a = c(2 + c)((l-c) 2 + 4d), (81) 

. c = (1 - 6) r c) , (82) 
(l-c) 2 + 4d V 7 

^"< 1+c Ktr^TiH- (83) 

When (1 - cf + 4d < 0, then t?(tu) is concave, and «9(1) > and tf(-l) > 
are sufficient for $(w) > 0. When (1 — c) 2 + 4<i > 0, then ■d(w) is convex and 
we consider three cases dependent onro c : w c < —1, u> c > 1, and —1 < w c < 1. 
When w c < -1, tf(-l) > is sufficient for > 0. When w c > 1, > 

is sufficient for i?(w) > 0. For — 1 < w c < 1, we need to show i)(w c ) = (3 > or 
equivalently 

(1-cf + Ad - 1 (84) 

because d < 0. 

Since w 2 < 1 and (1 — c) 2 > — 4d > 0, we have 

N9 ((l-c) 2 +4rf) 2 

(l-^) 2 < 1 n '—2 '— (85) 
(1 - c) 



Thus, 



(1-fe) 2 <l-c) 2 +4d , 

< —, ,2 ^ 1 ( 86 ) 



(l-c) 2 +4d (i_c) 

where we used d < for the second inequality. Hence i){w c ) > 0. 
Therefore, we have the following requirements. 

d < (87) 

0<6 + c<2 + 2d (88) 

-2d<b-c<2 (89) 

be - c 2 - 2d > (90) 

6c + 2d + c 2 - 2c < (91) 
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□ 



Note that 



-d < b < 2 + d, 
-1 < c< l + 2d. 



(92) 
(93) 



5 Numerical Experiments 



When d = 0, &xa<3'ax — 0. In this case, according to (|19j) 



F = &. 



(94) 



and the filter reduces to the linear diffusion type. Historically, the resulting scale 
space is called Gaussian. In this section, we compute frequency responses of 
filters at various settings, and compare them to the Gaussian scale space. 

Let's first look at two instances of the linear diffusion type, which can illus- 
trate how the mixing coefficients (/ii and fi 2 = 1 — fJ-i) and two eigenfunctions 
(Ai(0) and A2(0)) contribute to the overall frequency response F l (9). 

The frequency responses of a matrix of filters with t = 1 /4, b = c = 1 and d = 
at I = 1, 50, 100, and 150 are shown in FigurcHJ Note that the scale parameter 
t contributes to the speed of the smoothing and does not change the scale space. 
In the figure, (a) shows F , the magnitude of the frequency responses, (b) shows 

a mixing coefficient, (c) shows A' 1; and (d) shows A 2 . This is a special case 
where A{6) = since a xx (6) = a aa (0). Thus, Ai(0) = A 2 (0) = (1 - 2t) + 2t cos 0. 
With two eigenfunctions being equal, the mixing coefficients are arbitrary. As 
stated in Section [3l we set them to fxx = /i 2 = 1/2. However, regardless of the 
choice of the mixing coefficients, F l {9) = (/ii(0) + ^2(8)) &xx(®) = a xx(8) = 
((l-2i) + 2<cos6») ( . 

The frequency responses with t = 1/4, b = 1, c = 1/2, and d — are shown 
in Figure [3] with the same arrangement with Figure [2] In this case, A(8) 7^ 0, 
and the mixing coefficients are uniquely determined. They are either or 1, 
and switch the value at the point where the sign of <r xx — a aa changes. Since 
<j aa = 1 — 2t + tcos8 with 6 = 1 and c = 1/2, the switch occurs at 6 = w/2. 
When (j, k (0) = 1, A fc = a xx , and when fi k (6) = 0, A fc = a aa . Note that \ k {6) 
does not contribute to F l (0) when Hk(0) = 0. Therefore, F l = a l xx , and is not 
dependent on a aa . 

With d strictly negative, b has to be positive according to (|92]l. We are allowed 
to set c = according to ([93]) . which we will do since the setting results in a 
simpler form of the filter (a smaller number of non-zero coeffcients) . Then, the 
requirements given in Theorem [5] reduces to 



The smallest allowable d is thus —0.5, which makes b = 1.0. We choose the small- 
est d so that the resulting filter may exhibit behavior that is more distinguishable 
from the linear diffusion case than the one with dwO. 



d < 0, 

-2d <b<2 + 2d. 



(95) 
(96) 
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The frequency responses of the above matrix of filters (t = 1/4, b = 1, c = 0, 
and d = —0.5) at I = 1, 50, 100, and 150 are observed and shown in Figure 
[U The arrangement of the plots in the figure is the same as in Figure [21 With 
d =/= 0, the mixing coefficients are no longer binary and \ii decreases from 1 to 
as 8 goes from to n, almost in a linear fashion. More specifically, with this 
setting, we have 

cos9 .„„. 
= 1 + -5- (97) 



V6 - 2 cos 28 
A = - . (98) 

Note that </> = a xx + a aa = (2-2((l+6)t)+2t(l+c) cos6>. Thus, <p (as well as tp = 
&xx — faa) is always a cos# with scaling and offsetting. Since the eigenfunctions 
are ^ ± V~A is responsible for any characteristics of As deviating from cos 9. 
Note that A consists of cos 29, which is a key in curving out a frequency response 
profile that is different from the linear diffusion case. 

In Figure El the eigenfunctions and their constituents are shown. Ai and A2 
are shown with solid lines, tfi/2 is shown with a dotted line, and V~A/2 is shown 
with dashed-dotted line. \f~Aj2 provides deviation of As from <$>/2, which is a 
scaled copy of cos 6 . To show the degree of the deviation and how \f~A tunes 
As, 4>/2 ± 1/4 are shown in Figure [5] with dashed lines. These curves coincide 
with As at 6 = and 7r but deviate from them elsewhere. By the comparisons, 
the slope of A2 (which is above Ai) is smaller around 6 = and larger around 
6 = 7r than cos 9. On the other hand, the slope of Ai is larger around 6 = and 
smaller around 9 = ir. By weighting more on A2 near 9 = and more on Ai near 
9 = 7r, we might be able to bring a frequency response with a sharper cut-off 
than cos#, the Gaussian scale space case. However, since /iiAi +112^2 = &xx, this 
does not happen at the first iteration. However, as the iteration (I) increases, 
A 2 tends to hold its frequency profile near 8 = better than the Gaussian 
counterpart, thanks to its flatter profile around 9 = 0. As a result, the bandwidth 
of F l = ^,iX l 1 +fi2^ l 2 does not diminish as quickly as that of a l xx , which we observe 
in Figure |U 

To implement the above filter, we can set the temporal filters as 

f xx = [t, 1 - 2t, t^- 1 (99) 

faa = [1/2] (100) 

fax = [VIA 0, - ^iTAz- 1 (101) 

fxa = [-aAA 0, ^Tj2]z-\ (102) 

Note that the requirements of f ax and f xa are a ax a xa = d = —1/2, /3 ax = f3 xa = 
0, "fax = -«ai, and j xa = —a xa - Thus, the above setting is the most balanced 
one, but just one of infinitely many. One may want to set instead 

f ax = [1, 0, - l]z- x (103) 
fxa = [-1/2, 0, l/2}z~\ (104) 
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so that they can be implemented more efficiently without multipliers. 

We claimed that the bandwidth of F l decreases more slowly for the instance 
shown in Figure [4] than for the Gaussian case shown in Figure [2j To reveal 
that scale spaces resulted from these two filters are indeed different and not an 
superficial one due simply to the speed of the smoothing, the frequency responses 
of two filters from each respective configurations are shown in Figure El The 
response with 6 = l,c=d = 0at 5th iteration is shown in dashed while the 
response with b = 1, c = and d = —0.5 at 35th iteration is shown in solid. 
Note that due to the constant reduction requirement of scale spaces, frequency 
responses of a linear diffusion filter at two iteration points cannot intersect each 
other. Thus, the filter response shown in solid cannot be produced by the linear 
diffusion kernel, and the resulting scale space is different from the Gaussian one. 




Fig. 2. Frequency responses of a (Gaussian) matrix of filters with b = 1, c = 1, 
and d = 0. 



Another design philosophy to consider is to create a sharp cut-off in the 
frequency response profile. Under such approach, wc may want to find a set of 
parameters that maximizes F'(7r/16) — F l (ir/4) at say I = 100, while satisfying 
the constraints of Theorem [2j This is a non-convex optimization problem and 
can be solved numerically with various software packages. 

By a Matlab® Optimization toolbox, wc obtained b = 1, c = 0.48, and 
d = —0.26. The result was not sensitive to initial conditions, which were set 
randomly. The frequency response of the filter at I = 100 is shown in Figure [7] 
along with the response of the Gaussian counterpart. The amount of fall-off for 
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Fig. 4. Frequency responses of a matrix of filters with b = 1, c = 0, and <i = —0.5. 
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Fig. 6. Comparison of two niters: Gaussian (b = 1, c = d = 0) and Non-Gaussian 
(6= 1, c = 0, d = -0.5). 
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the non-Gaussian case is 0.93 while that of the Gaussian case is 0.41 and that of 
a non-Gaussian case with b = 1, c = and d = —0.5 (the filter shown in Figure 
HJ is 0.83. 




Fig. 7. Comparison of two filters at I = 100: Gaussian (b = 1, c = d = 0) 
and Non-Gaussian (b = 1, c = 0.48, <i = —0.26). The parameters for the non- 
Gaussian case are obtained by constrained non-linear optimization to maximize 
the fall off between 9 = tt/16 and 9 = tt/4 (in other words, F z (tt/16) -F'(tt/4).). 
The fall-off for the Gaussian case is 0.93, and that for the Gaussian case is 0.41. 



6 Discussion 

One question that naturally arise from the illustration given in Figure[5]regarding 
the frequency profiles of the constituents is if it is possible to generate the same 
frequency response of the matrix of filters by using a conventional convolution 
kernel with a larger support (more than 3 non-zero coefficients). For example, 
we can use an equivalent filter at some I as the convolution kernel. The answer 
to the question is no, since the formulae of the frequency responses for the two 
cases arc different; For a conventional convolution based case, 

F\6) = {K{9)) 1 , (105) 

where K is the frequency response of the convolution kernel. On the other hand, 
the frequency response of a matrix of filters is given by 

F\6) = (Ai(0))' + fx 2 {0) (A 2 (0)) ! . (106) 

Thus, (|105|) cannot generate (|106[) in general. As seen in Scction[Sl the converse is 
not true, and (|106[) can generate any instance of (|105j) by setting <j xx {0) = K(9) 
and d = 0. 
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In this paper, we have limited our study to the 2x2 case. Even with such 
minimal configuration, the resulting equivalent filter is able to construct a non- 
trivial (or non-Gaussian) scale space. With larger configuration, we expect that 
more elaborate frequency responses are possible. Note that the original EQW 
employed a 3 x 3 matrix of filters. It is however, difficult to extend the analysis 
described in this paper to the general case. Closed form expressions of eigenvalues 
are not possible for P > 4, and although they exist for P < 4, deriving sufficient 
conditions for scale space filtering can be extremely complicated. 

We can extend the matrix size while imposing some structural constraints 
on the matrix. For example, we can consider a P x P matrix of filters that are 
circulant. Then, we will be able to derive a simple expression for the frequency 
response of the equivalent filters. In this case, the mixing coefficients are all 1/P, 
thus the frequency response of the equivalent filter becomes 

^w = 4E a ^) ( 107 ) 

3=0 

with 

p 

a#) = Y J F lk {e)p 3 P (108) 

fc=0 

where Fife is the frequency response of fife and pp is the Pth root of unity. Note 
that at P = 2, this circulant configuration leads to a xx — a aa and in turn leads 
a Gaussian scale space. It is not clear if the same can be said for P > 2. 

Without closed form expressions of eigenvalues, we resort to numerical schemes. 
Give a matrix of filter, we want to test if the filter satisfies the scale space re- 
quirements. We need to come up with numerical conditions that guarantee the 
positivity and unimodality requirements at every 9 and the constant reduction 
requirement at every I. 

So far, we assumed that each convolution filter is circulant. We can extend 
the results for non-circulant filter with some type of extension schemes such as 
zero padding and reflection, given an upper limit of the iteration number. Let L 
be the upper limit of the iteration number. Then, the length of the equivalent 
filter is at most 2L + 1. Then the result of the iterative filtering can be obtained 
by first extending the original signal by L on both ends by the chosen exten- 
sion scheme, apply the circulant filters to the extended signal, and truncate the 
result at the portion of the original signal. Thus, non-circulant filter can be im- 
plemented by circulant one with proper extension. Given a scale space of a signal 
(i.e. a collection of signals that satisfy the scale space requirements), a truncated 
portion of the signal also satisfies the scale space requirements. Thus, the suffi- 
cient condition for the scale space filter remains applicable to the non-circulant 
case. 
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7 Conclusion 

In this paper, we first derived the frequency response of a general matrix of filters 
applied iteratively to the signal. The response is a convex combination of the 
power of eigen-functions describing the impulse response of the filter. We then 
studied a 2 x 2 matrix of filters and derive sufficient conditions for it to be a 
scale space kernel. We showed that the 2x2 matrix of filters can generate non- 
Gaussian scale space, thus are more powerful than the conventional convolution 
kernel. 

Future research goals include extension of the study to more general matrix 
sizes. We suggest investigating some general cases such as circulant one and tri- 
diagonal one, and derive sufficient conditions for the scale space requirements. 
For more general cases, we suggest deriving a numerical test that checks if the 
given configuration satisfies the scale space requirements. 
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